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ABSTRACT 

The purpose of this study was to design, produce, and 
evaluate testing reports that would be useful and meaningful at the 
classroom level; reports that would be useful to teachers and 
informative to parents, without making time demands on teachers in 
either preparation of the reports or in inservice training in 
educational measurement. The Iowa Tests of Basic Skills was chosen 
for the study. Every item of Form 3 of the fourth-grade level test 
was analyzed by a group of classroom teachers, and the appropriate 
subject-matter curriculum coordinators of the school system. Also 
examined was the Modern Mathematics Supplement to the tests. Three 
reports were designed: a parent report, a teacher report, and a 
class-summary report. A brief discussion of each of these reports is 
given. (Author/DB) 
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COMPUTER-GENERATED VERBAL TESTING REPORTING 



Walter M. Mathews 
University of Mississippi 

A Paper Presented at the 56th Annual Meeting 
of the American Educational Research Association 

April 6 » 1972 
Chicago 

While examining the standardized testing program of 
a medium-sized public school system, it was observed that 
aside from the reports containing the student scores, all of 
the testing reports had the school administration as their 
target audience. A large volume (217 pages) was published 
annually which contained tables of data and analysis of the 
performance of the total school system and of each of its 
53 schools. This volume had no direct impact on teaching 
and learning at the student level, and the majority of the 
members of the teaching staff was not even aware of its 
existence. 

Two testing reports were routinely distributed to 
each school : 

1. a list of students and their test scores for the 
information of the guidance counselor or class- 
room teacher, and 

2. a gummed label containing the same Information 
for affixation to the cumulative record of each 
student . 
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Achievement tests were usually reported in terr.s of 
three scores: 

1. a percentile rank on local norms, 

2. a percentile rank on national norms, and 

3. a grade-equivalent score. 

These reports provide pertinent statistics. Unfortunately , 
too many teachers are not able, or do not take the time to 
analyze the tables of percentiles and grade-equivalent scores. 
The only information provided to the student and/or the 
parents of the pupil is what the classroom teacher interprets 
(or is capable of interpreting under the limitations of time 
and understanding) to them. 

The Purpose 

The purpose of this study was to design, produce, and 
evaluate testing reports that would be useful and meaningful 
at the classroom level: reports that would be useful to 

teachers and informative to parents, without making time 
demands on teacher in either preparation of the reports or 
in inservice training in educational measurement. 

The Approach 

The Iowa Tests of Basic Skills, a widely used achieve- 
emtn battery, was chosen for the study. Every item of Form 3 
of the fourth-grade level test was analyzed by a group of 
classroom teachers, and the appropriate subject-matter cur- 
riculum coordinators of the school system. Also examined was 
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the Modern Mathematics Supplement to the Iowa Tests of Basic 
Skills. Three reports were designed: a parent report, a 

teacher report, and a class-summary report. A brief dis- 
cussion of each of these reports follows. 
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The Parent Report 

To provide information to the parents of each pupil, 
an individual report in a verbal format was generated for 
each child's performance. The only scores reported to the 
parent in numerical form were the national and local per- 
centiles for the pupil's total test score. Reports on all 
of the subscores utilize one of the verbal descriptors 
(exceptional, very strong, quite strong, near average, 
rather weak, or very weak). Diagnostic keys in 25 skill 
areas (e.g., subtraction, using verbs, and solving problems 
involving money) were printed if a pupil's score in that 

area was determined to be either proficient or deficient. < 

Since the mechanical interpretation of a pupil's 

j 

performance on the test did not take into consideration . 

unique factors in the child's background or indicants of 4 

improvement which may be known to the teacher, space on the 
computer-generated reports was designed for teacher comments. 
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PARENT REPORT ON INDIVIDUAL PERFORMANCE on The IO*A tests of BASIC SKILLS 

ADMINISTERED SEPTEMBER 1*70 
MADISON PUBLIC SCHOOLS 
MADISON, WISCONSIN 

STUDENT: DANIEL MARSHALL GRADE! R 

teacher: mrs, franklin school: jeffersqn 

ACCORDING TO THIS TEST, DANIEL'S OVERALL AC h IEVEM£NT LEVEL IS AT THE 78 
p E r CENTIL£ a HEN cOmPARep w I Th STUpgNTS IN 6 R A0E *♦ I N T HE MADISON ScHOOl STSTfiM, 
AND AT THE 3R PERCENTILE >,HEN COKPa*E0 wITH A NaTIONAL SaMRLE OF GRADE R 
STUDENTS* 

The T E ST PROVtQES INFORMATION IN FIVE MAIN AREAS! DANIEL'S VOCABULARY 

sco R e is near average while “is reading comprehension score is near average* in 
The area OF LANGUAGE skills his SCORE is quite STRONG, and his score in work* 
study SKILLS IS VERY STRONG • HtS ARITHMETIC ScORfi IS EXCEPTIONAL • 

the Test looked at four specific language skills, and this student was 
Rated AS FOLLO.vSI quite STRONG IN SPELLING ANO quite strong in capitalisation, 

VERY STRONG I* PUmcTUATION AND NEAR AVERAGE IN WORD USAGE* 

IN The area Op WORK-STUDY SKILLS, THREE SPECIFIC SKILLS WERE TESTED* IN 
map READING, DANIEL SEEMS TO BE QUITE STRONG WHILE HIS IS NEAR AVERAGE IN READ- 
ING graphs and table's* in his knowledge and use op reference materials he is 

QUITE STRONG* 

IN T me AREA OF ARITHMETIC* HE APPEARS TO gE NEAR AVERAGE IN CONCEPTS AND 
VERY STRONG in PROBLEM SAVING H'MILE HE TENDS To be EXCEPTIONAL in The mOOERn 
M a T - M A T I C 5 SUPPLEMENTARY TEST. 

diagnostic keys indicate that oaniel is proficient ini 

SOLVING PROBLEMS INVOLVING MONEY* 

SUBTRACTION, 

ADoiTJDN. 

UNDERSTANDING the CONCEPT OF .VMOlE NUMBER IN MODERN math, 
diagnostics also indicate that daniel is deficient inj 

SPELLING BECAUSE OF PROBLEM'S IN VOWEL SUBSTITUTION, 

using the comma* 

PUNCTUATION because OF OVERPUNCTUATIOn. 

student performance is evaluated in several waysi by the teacher, by the 
par?>ts of the student and, of course, by the student mihself. test results do 
not replace any op these, but can be valuable in That they are another source of 
Data. THIS test, UKE any test, IS SUBJECT to ERROR. 



comments about Daniel marshall prom mrs* pranklin i 
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The Teacher Report 

For each pupil, an individual report was generated 
for the teacher. The report for the teacher was almost 
identical to the report for the parents with the addition 
of percentile scores for each of the 15 subscores. The 
narrative on each set of reports for a pupil was identical; 
the particular form of each paragraph that was generated 
was determined by the digits in his student number. Since 
several alternative narrative forms of each paragraph were 
available for printing, the value of a specific digit or 
combination of digits in the pupil’s school identification 
number was used to determine which of the parallel verbal / 

forms of each paragraph was printed. 

The teacher report ends with the same caution con- 
tained on the parent report: that tests are fallible and ^ 

are only one way of measuring pupil performance. 
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TEACHf* REPORT ON tNUTVTiJUAL PTRTFORMancE ON The fd»A TESTS OF BASIC SKILLS 

ADMINISTERED SEPTEMBER [970 

MADISON PUBLIC schools 

MADISON, WISCONSIN 

STUDENT! OA-NIEL MARSHALL GRADE S N 

teacherj mrs, tranklin school: Jefferson 

ACCORDING TO THIS TEST* DANIEL’S OVERALL ACHIEVEMENT LEVEL IS AT THE ?3 

percentile a ’hen compared *ith students in grade m in the maoison school system, 
a\p at the br percent i l£ when compared kith a national sample of grade <* 

STUDENTS* 

The T e ST PROVjoeS INFORMATION in FIVE main AREAS! DANIEL’S VOCABULARY 
score is near average <bs «ile> .vhile his reading comprehension Score is 

neap AVERAGE (56 BILE)* In THE ARE* OF LANGUAGE SKILLS HIS SCORE IS 
QUlTg STRONG (71 f jl£) * AND hJS SCORE IN WORK-STUDY SKILLS IS VERY STRONG 
m 8 ILE>* HIS ARITHMETIC SCORE IS EXCEPTIONAL (91 SJLE) • 

The test LOOKED at FOUR SPECIFIC LANGUAGE SKILLS, ANO THIS STUDENT *AS 
Ranked as FOLLOWS: QUITE STRONG in SPELLING <7* SILS) ANO SUITE STRONG IN 
CAPITALISATION (71 BILE), VERY STRONG IN PUNCTUATION (87 BILE) ANO NEAR AVERAGE 
IN ’"ORd USAGE (S3 8ILE1* 

in The area Of work-study skills, three specific skills here tested* in 

MAP READING* DANIEL SEEMS TO BE QUITE STRONG (73 BILE) H£ IS NEAR AVERAGE 
IN READING GRAPHS anD TaBLES (MB BILE). IN HIS KNOWLEDGE AND USE OF REFERENCE 

materials he is quite strong ( 7i silej* 

In The area of ARITHMETIC, HE APPEARS to gE near AVERAGE in CONCEPT^ 

(57 *ILE) AND VERY STRONG IN PROBLEM SOLVING ( a 3 BILE) WHILE HE TENDS To 
OE EXCEPTIONAL IN THE MODERN *! ATHE* AT I cS SUPPLEMENTARY TEST (93 1 1 LE ) • 

diagnostic keys indicate that daniel is proficient in: 

solving problems involving money, 

SUBTRACTION, 

ADDITION* 

UNDERSTANDING The CONCEPT of .’-hole number in MODERN math* 
diagnostics also indicate that daniel is deficient ini 

SPELLING B£cAU5E °F PROBLEMS IN VOWEL SUBSTITUTION, 

USING The COMMA. 

PUNCTUATION BECAUSE of overpunctuatiOn. 

STUDENT PERFORMANCE IS EVALUATED IN SEVERAL «aysi by the TEACHER, by The 
parents of the student and, of course, by the student himself, test results do 
hot REPLACE any OF TRESE, but Can BE VALUABLE in That TmEy are ANOTHER SOURCE of 
DATA. THIS test, lI«E A*‘Y T£ST, JS SUBJECT TO fiRROR. 
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The Class Report 

The third type of report that was generated was 
designed for the use of the teacher. This report began with 
five paragraphs of text that were similar in design to those 
already described for the parent report and the teacher re- 
port, but the narrative describes the performance of the 
class as a whole. Both verbal descriptors and mean percen- 
tile ranks were used to describe the group's performance on 
each test, and totals were given for the number of students 
that were either deficient or proficient in each of the 25 
diagnostic areas. 

For each of ten areas that were tested by the Iowa 
Tests of Basic Skills battery, practical suggestions were 
designed by classroom teachers in conjunction with subject 
matter coordinators. For each area in which the class mean 
was below the mean of the school system in that area, a list 
of suggestions was printed on the class report. If the 
class mean was not below the district mean in at least one 
area, the di scrimi natory percentile rank was raised by ten 
points until at least one set of suggestions was printed. 

The class report ended with a listing of human resources 
that were available to the teacher from the central adminis- 
trative offices* particularly subject-matter consultants. 
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RP*dRT -1 ; CLASS PERFORMANCE 0^ THE IO*A TESTS OF SASIC SKILLS 

administered September 1970 

MADISOW PUBLIC SCHOOLS 
MADISON, WISCONSIN 



TEACHEPI MrfS# HAHItTON 



SRAoEI S 



SCHOOL! FALK 



The MEAN ACHIEVEMENT LEVEL OF THE STUDENTS IN YOUR CLASS IS AT THE 59 PER- 
CENTILE ■'HE THEIT test SCORES *Re COMPaREO to the other FOURTH-GRADE STUDENTS 
in the Masson pu* l jc School system, the mean achievement level of your students 
is at the 55 percentile then compared "'iTh a national sample of fourtm-gRaqe 

STUDENTS# 

T h jS TEST PPOVIJE 5 INFORMATION IN FIVE HAIM ARfiASl IN VQcab u LARY, THE ME* N 
of This CLASS *S IcaR AVERAGE (59 «ILE>, WHluE iT IS NEAR AVERAGE in REAUIlG com- 
prehension (97 8 1 LP ) » THE CLASS ME*N IS NEAR AVERAGE IN LANGUAGE SKILLS (SS HlE) 
AND NE*R AVERAGE I#j WORK-STUDY SKILwS ($0 SlLE). THE MEAN SCORE OF THIS GROUP IS 
NEAR AVERAGE l i ARITHMETIC SKILLS (50 S I LE ) • 

LOO<r.G A LITTLE CLOSER at This CLASS* LANGUAGE skills, thet tend TO be 

NEAR AVERAGE IN SPELLING (57 SUE) A NO NEAR AVERAGE IN CAPITALIZATION t * 1 slLEI. 

THERE are INDICATIONS That t w js CLASS is NEAR AVERAGE IN PUNCTUATION (87 silei 
AND n£aR AVERAGE 1*1 »ORD USAGE (50 *lLE># 

IN The AREA Of VOR<-STJDY SKILLS, THIS GROUP, AS A «HOLE, APPEARS TO s,£ 

NEa* AVERAGE 1 4 HAP READING (59 SILE), NEAR AVERAGE IN REAOING GRAPHS AND TABLES 

(55 a I LE I , AMD NEAR AVERAGE IN KNOWLEDGE AND USE OF REFERENCE MATERIALS <55 8IL£|, 

WJTH REGARD To THE ARITHMETIC SKILLS OF YquR STUDENTS, THE CLASS MEAN SHQ l *S 
The-! TO BE ' j EAR AVERAGE IN ARITHMETIC CONCEPTS (SS SILEI WHILE THEY APPEAR TO b£ 
WEAK AVERAGE I 4 PROBLEM SOLVING (so silei# on the MODERN MATHEMATICS supplement 
The SCORES op The STUDENTS SEEM To aE NEAR AVERAGE (57 SlLEI# 

FOLUO IMG ARE the NUMBERS OF STUDENTS IN YO^R CLASS OF 19 "HO >ERE «ATED 
either PROplClFNT or DEFICIENT JN TH£ VARIOUS DIAGNOSTIC AREASl 



prof. DEP# 



DIAGNOSTIC AREA 



1 

2 

• • 

2 

5 

9 

5 

2 

3 

9 

«• 

19 

ID 

a 

o 

H 

3 

0 



2 recognizing and understanding important facts ano details, 

2 RECOGNIZING and UNDERSTANDING IMPLIED FACTS AND RELATIONSHIPS# 
9 SPELuHs BECAUSE OF PR09LEMS IN VO^EL SUBSTITUTION.* 

9 using verbs# 

7 jsi-jg verb forms. 

1 o using The comma, 
a using ThE PERtOD# 

id usi i« internal punctuation in a sentence# 

7 using terminal punctuation in a sentence# 

9 MSI'IS LETTER- 'RITING punctuation# 

5 USI 1*3 TOO MUCH PUNCTUATION#* 

1 using capitalization in letter Siting. 

5 capitalization of geographic terms# 

5 capitalization of human names ano references To humans, 

9 LOCATING PLACES O') MAPS ANO GLOBES. 

2 ALPHABETIZING# 

6 USING AN INDEX# 

1& USING A DICTIONARY# 
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3 1 2 visits general reference *uterUls, 

H 6 UNDERSTATING ThE CONCERT Of IMOLC NuHBCR* 

1 a -OR<IN:i PROBLEMS USING ■MOLE NUMBERS, 

6 7 SOLING PROBLEMS INVOLVING MONEY* 

2 7 SUBTRACTION* 

7 5 ADO I T I On • 

?. & understanding the concept of whole number in mooeRn mathematics, 

{« PRnFtcJSJCT IS NOT MEASURED IN THIS AREA* ) 

Test results never REPLACE Teacher judSmentSi they are only A HELP TO the 
teacher in forming more reliable judgments, this test# like any test, is subject 
to f.rror* 



follo 1 ing are practical suggestions for improving the achievement levels 

of YOUR STUDENTS In THE AREAS THAT YOUR CLASS AVERAGE »AS 8EL0M/ ThE MEAN OF ALL 
The FOURTh-GRADE PUPILS IN The MADISON PUBLIC ScHOOLSI ^suggestions IN OTHER 
AREAS are AVAILABLE FROM ThE PROJECT DIRECTOR* ) 
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•SUGGESTIONS rot lMf»*OVl,Nt; FADING comprehension 

suggestions rot developing ability to recognize and understand stated or 
implied factual details and relationships 

from the beginning grades on, reading rot thought must be emphaSizeo* children 

DO NOT SUqdEnlT LEaRN TO READ V. jTh COMPREHENSION IN THE SjXTH GRADE I THOUGHTFUL 
READING at That level IS TmE RESULT of a long Period OF GROWTH BEGINNING IN The 
FIRST GRADE* NO AMOUNT OF ORILL AT The HIGHER LEVELS CAN HAKE UP FOR A LACK OF 
ATTENTION TO READING AS a THOUGHT-GETTinG PROCESS IN The HIDDLE or lower grades, 

many of The following suggestions therefore* should be of value to teachers at 
The LO--*’E* >' j ELL aS the higher grade LEVELS* 



(CIRCLE °NE> 

I usually do* 

I DON»T USUALLY, 



I USUALLY DO* 

i qon»t usually, 

I USUALLY do, 

I don»t usually, 

i usually do, 

I DOf'»T USUALLY, 

I USUALLY DO. 

I don • t usually. 



i usually oO, 
i oon*t usually, 

i usually do, 

I d o n • t usually. 



i usually do, 

I don»t usually, 



it RHEN asking QUESTIONS, avoid THE TERMINOLOGY of The 
CONTEXT, aSK QUESTIONS WHICH CANNOT BE ANSWERED W{Th 
•YES* or »NO»» ASK QUES T tONS WHICH REQUIRE SOME THOUGHT 
HAVE PUPILS EXPLAIN «HO** AND *WHY* INSTEAD OF ASKING 
Them »WMO,* »WhEN, * ’WhAT,* ’WHERE,* OR *HOW many,* 

2, use BOTH OBJECTIVE AND SUBJECTIVE TECHNIQUES IN ASKING 

direct factual questions about ’Significant* details, 

3* ASK PUPILS TO FIND DETAILS WHICH SUPPORT A GIVEN TOPIC 
SENTENCE OR MAIN IDEA, 

R* AS< PUPILS TO IDENTIFY IRRELEVANT DETAILS *MJCH OO NOT 
CONTRIBUTE TO THE MAIN POINTS OF THE SELECTION, 

5, FREQUENTLY GIVE DIRECTIONS FOR LESSONS IN WRITTEN FORrl 
So THAT CHILDREN will lEARN to follow PRINTED DIRECT- 
IONS, 

6, IN CONSIDERING NEW WORqS, EMPHASIZE MEANINGS AN0 USE 

in context rather than the phonics of the ioros* 

7, in NO CASE, FROM THE FIRST GRAOE ON, PERMIT VERBALISM, 
The MERE READING OF words, INSIST that CHILDREN KNOW 

"'hat they are reaoing about, 
s* employ Questions which Require The pupils to oraw 

CONCLUSIONS and hake INFERENCES IN ORDER to ARRIVE at 
answers which aRe not definitely stated in the context. 
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• SUGGESTIONS FOR DEVELOPING S<ILl. IN DISCERNING T «E PURPOSE ON MAIN IDEA OF A 
PARAGRAPH OH selection 

(CIRCLE OnE) 



4 

i 



I USUALLY DO* 

I DONAT USUALLY, 



I USUALLY I 0 * 
i dom*t usually* 

I usuall v do* 

1 DON * T USUALLY. 



I USUALLY :>0, 

I don * t usually. 



I USUALLY Il0, 

I don»t usually. 



1. USE OBJECTIVE EXERCISES in ‘'HIGH ThE PUPILS 1 OENT J FT 

'THf'TDPJc SeNTeNCE'OF A SINGLE RaRaGRaPH* IF NECESSARY 
segtn «ith paragraphs in which the topic sentence is 
reasonably apparent, 

Z. HAVE CHILDREN PROVIDE ORALLY or IN WRITING tmieR DAN 

statements of the topic sentence of single paRa«Rafhs. 

3, PROVIDE MUlTIPlE-CHOICE EXERCISES IN WHICH PUPILS 

identify the main Idea or ioeas of paragraphs or longer 
selections in which there are no clear-cut statements 
OF THE CENTRAL IDEA, 

*♦, HAVE PuRILS STaTE IN ThEIR OWN words tme main idea of 
ideas of paragraphs or longer selections WHICH 00 not 
contain a definite TOPIC sentence* AS pupils DEVELOP 

SKILL IN 0ISCERNIN6 THE RAIN IDEA* THEY SHOULD »E GIVEN 
EXERCISES IN WHICH THE CENTRAL IDEAS ARE LESS OBVIOUS* 

S, ASK QUESTIONS SUCH AS *WHAT *AS THE AUTHORS PURPOSE IN 
WRITING THIS ARTICLE?* OR • WHAT IS THE ONE MOST 

important Thing to rehehser from the selection?* 



> 
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PLEASE FREELY CONSJLT YOUR BUILDING READING resource TEACHER and mathematics 
Cadre MEMBER ABOUT FURTME^'DTASIJTSTIC^TESTS that A*r available, AND about SPECIFIC 
MATERIALS that can be made available TO YOU for use IN your classroom* ALSO 
AVAILABLE TO GIVE vOU SUPPORT JN THESE AREAS ARgi 

* 

YOUR REMEDIAL READING CONSULTANT! mRS* ALICE BENN, 

YOUR DEVELOPMENTAL READING CONSULTANT! MRS, KATHLEEN MARTY, 

YOUR ENGLISR'WlANSUaGE ARTS COORDINATOR: MR, LEE HANSEN, 

YOUR MATHEMATICS COORDINATOR: 1R P£ T £R CHRIST: ANS£N, ] 

TOUR SOCIAL STUDIES COORDINATOR! mR»OMAR kuS$OW» j 

they m*y 9 p contacted at the administration building by calling 257-75*1* 1 

i 

if ydu have a-iy questions or comments about These reports, please call mr. I 

MaT^e>VS, The PROJECT DIRECTOR, a^ 257 - 75*1 EXTENSION 252 » 9 e HOPE These j 

RpP 3 RTS ARE HELPFUL TO YOU, j 

j 

\ 

$ 

i 

i 

i 

5 

I 

1 

1 
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The Evaluation 

On a random basis, 52 teachers from 17 schools in 
the school system received either the traditional or ex- 
perimental testing reports for their classes. The teachers 
were asked to evaluate the reports that they received for 
each of three uses: (1) the information that it provided 

to the teacher on individual pupil performance, (2) the sum- 
mary information that was provided to the teacher on the 
performance of the class as a whole, and (3) the informa- 
tion that it provided to the teacher for use at a parent- 
teacher meeting. To gather data on each of these three 
questions, six scales were used, namely: clear, useful, 

meaningful , valuable, sufficient, and accurate. On 15 of 
the 18 comparisons between the mean ratings of the tradi- 
tional and experimental reports, the experimental reports 
were rated significantly higher (*<, < ,01). 
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